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Abstract 



^ We advocate a compressed sensing strategy that consists of multiplying the signal of interest by a wide 

bandwidth modulation before projection onto randomly selected vectors of an orthonormal basis. Firstly, in a 
OO digital setting with random modulation, considering a whole class of sensing bases including the Fourier basis, 

we prove that the technique is universal in the sense that the required number of measurements for accurate 
recovery is optimal and independent of the sparsity basis. This universality stems from a drastic decrease of 
coherence between the sparsity and the sensing bases, which for a Fourier sensing basis relates to a spread of the 
y—i original signal spectrum by the modulation (hence the name "spread spectrum"). The approach is also efficient 

^ as sensing matrices with fast matrix multiplication algorithms can be used, in particular in the case of Fourier 

measurements. Secondly, these results are confirmed by a numerical analysis of the phase transition of the £i- 

}_j minimization problem. Finally, we show that the spread spectrum technique remains effective in an analog setting 

^ with chirp modulation for application to realistic Fourier imaging. We illustrate these findings in the context of 

radio interferometry and magnetic resonance imaging. 



1 Introduction 

In this section we concisely recall some basics of compressed sensing, emphasizing on the role of mutual 
coherence between the sparsity and sensing bases. We discuss the interest of improving the standard ac- 
quisition strategy in the context of Fourier imaging techniques such as radio interferometry and magnetic 
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resonance imaging (MRI). Finally, we highlight the main contributions of our work, advocating a univer- 
sal and efficient compressed sensing strategy coined spread spectrum, and describe the organization of this 
article. 



1.1 Compressed sensing basics 

Compressed sensing is a recent theory aiming at merging data acquisition and compression [l}|7] . It predicts 
that sparse or compressible signals can be recovered from a small number of linear and non-adaptative 
measurements. In this context, Gaussian and Bernouilli random matrices, respectively with independent 
standard normal and ±1 entries, have encountered a particular interest as they provide optimal conditions 
in terms of the number of measurements needed to recover sparse signals jsjjsj. However, the use of these 
matrices for real-world applications is limited for several reasons: no fast matrix multiplication algorithm is 
available, huge memory requirements for large scale problems, difficult implementation on hardware, etc. 

Let us consider s-sparse digital signals x E in an orthonormal basis = i/jjv) G C^^^. 

The decomposition of x in this basis is denoted a = (^Oi^i^Ar € C^, a = ^*x (•* denotes the conjugate 
transpose), and contains s non-zero entries. The original signal x is then probed by projection onto m 
randomly selected vectors of another orthonormal basis = (<pi, (Pn) e C^^^. The indices fl = 
{?!,..., l„i} of the selected vectors are chosen independently and uniformly at random from {1, . . . , N}. We 
denote <t)^ the m x N matrix made of the selected rows of <t>*. The measurement vector y E C™ thus reads 
as 

2/ = AaawithAo = 0?2^eC™^^. (1) 
We also denote A = 0*4' G C^^^. Finally, we aim at recovering a by solving the ^i-minimization problem 

a* — arg min ||q!||i subject to y = Asia, (2) 

where ||q;||i — X^iLi (M denotes the complex magnitude). The reconstructed signal x* satisfies x* — 
vl/a*. 

The theory of compressed sensing already demonstrates that a small number m ^ TV of random measure- 
ments are sufficient for an accurate and stable reconstruction of x [6j|7|. However, the recovery conditions 
depend on the mutual coherence /i between and U'. This value is a similarity measure between the sensing 
and sparsity bases. It is defined as /i = maxi^^j^Ar Kcjii^ipj)] and satisfies iV"^/^ ^ /i ^ 1. The performance 
is optimal when the bases are perfectly incoherent, i.e. /i — N"^^^, and unavoidably decreases when /i 
increases. 



1.2 Fourier imaging applications and mutual coherence 

The dependence of performance on the mutual coherence /i is a key concept in compressed sensing. It 
has significant implications for Fourier imaging applications, in particular radio interferometry or magnetic 
resonance imaging (MRI), where signals are probed in the orthonormal Fourier basis. In radio interferometry, 
one of the main challenges is to reconstruct accurately the original signal from a limited number of accessible 
measurements [8 - 12 . In MRI, accelerating the acquisition process by reducing the number of measurements 
is of huge interest in, for example, static and dynamic imaging 13 17, parallel MRI 18-20], or MR 
spectroscopic imaging 21-23 . The theory of compressed sensing shows that Fourier acquisition is the 
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best sampling strategy when signals are sparse in the Dirac basis. The sensing system is indeed optimally 
incoherent. Unfortunately, natural signals are usually rather sparse in multi-scale bases, e.g., wavelet bases, 
which are coherent with the Fourier basis. Many measurements are thus needed to reconstruct accurately 
the original signal. In the perspective of accessing better performance, sampling strategies that improve the 
incoherence of the sensing scheme should be considered. 



1.3 Main contributions and organization 

In the present work, we advocate a compressed sensing strategy coined spread spectrum that consists of a wide 
bandwidth pre-modulation of the signal x before projection onto randomly selected vectors of an orthonormal 
basis. In the particular case of Fourier measurements, the pre-modulation amounts to a convolution in 
the Fourier domain which spreads the power spectrum of the original signal x (hence the name "spread 
spectrum" ) , while preserving its norm. Equivalently, this spread spectrum phenomenon acts on each sparsity 
basis vector describing x so that information of each of them is accessible whatever the Fourier coefficient 
selected. This effect implies a decrease of coherence between the sparsity and sensing bases and enables an 
enhancement of the reconstruction quality. 

In Section|2j we study the spread spectrum technique in a digital setting for arbitrary pairs of sensing and 
sparsity bases (0,^^). We consider a digital pre-modulation c = (q)i^/^jv G with |q| = 1 and random 
phases identifying a random Rademacher or Steinhaus sequence. We show that the recovery conditions do not 
depend anymore on the coherence of the system but on a new parameter /3 (<t>, W) called modulus- coherence 
and defined as 



B (<t>. \|/) = max 



\ 



N 

|2 



k=l 



where (j)ki and V'fcj are respectively the k*^^ entries of the vectors (pi and xpj . We then show that this parameter 
reaches its optimal value /3(<t>,U') = N^^^^ whatever the sparsity basis 5*, for particular sensing matrices 

including the Fourier matrix, thus providing universal recovery performances. It is also efficient as 
sensing matrices with fast matrix multiplication algorithms can be used, thus reducing the need in memory 
requirement and computational power. In Section [3| these theoretical results are confirmed numerically 
through an analysis of the empirical phase transition of the -minimization problem for different pairs of 
sensing and sparsity bases. In Section |4j we show that the spread spectrum technique remains effective in 
an analog setting with chirp modulation for application to realistic Fourier imaging, and illustrate these 
findings in the context of radio interferometry and MRI. Finally, we conclude in Section [5] 

In the context of compressed sensing, the spread spectrum technique was already briefly introduced by 



the authors for compressive sampling of pulse trains in 24 , applied to radio interferometry in 25 26 and 



to MRI in 27-30 . This paper provides theoretical foundations for this technique, both in the digital and 
analog settings. Note that other acquisition strategies can be related to the spread spectrum technique as 
discussed in Section [231 

Let us also acknowledge that spread spectrum techniques are very popular in telecommunications. For 
example, one can cite the direct sequence spread spectrum (DSSS) and the frequency hopping spread spec- 
trum (FHSS) techniques. The former is sometimes used over wireless local area networks, the latter is used in 



Bluetooth systems 31 . In general, spread spectrum techniques are used for their robustness to narrowband 



interference and also to establish secure communications. 
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2 Compressed sensing by spread spectrum 

In this section, we first recall the standard recovery conditions of sparse signals randomly sampled in a 
bounded orthonormal system. These recovery results depend on the mutual coherence of the system. 
Hence, we study the effect of a random pre-modulation on this value and deduce recovery conditions for 
the spread spectrum technique. We finally show that the number of measurements needed to recover sparse 
signals becomes universal for a family of sensing matrices <t> which includes the Fourier basis. 



2.1 Recovery results in a bounded orthonormal system 

For the setting presented in Section [T] the theory of compressed sensing already provides sufficient conditions 
on the number of measurements needed to recover the vector a from the measurements y by solving the 
£i-minimization problem ^ 

Theorem 1 ( [7', Theorem 4.4). Let A = ct)*\|; ^ C^''^, fi = maxi^,^j<^N \{4>2,ipj)\, a € C'^ be an s- 
sparse vector, = {Zi, . . . , /„;} he a set of m indices chosen independently and uniformly at random from 
{1, . . . , N}, and y = AqCx G C™. For some universal constants C > and 7 > 1, if 

CN^i^s\og^{N), (4) 

then a. is the unique minimizer of the li-minimization problem with probability at least 1 — iV~T'°s (N) ^ 

Let us acknowledge that even if the measurements are corrupted by noise or if a is non-exactly sparse, 
the theory of compressed sensing also shows that the reconstruction obtained by solving the ^i-minimization 
problem remains accurate and stable: 

Theorem 2(7, Theorem 4.4). Let A = 0*4^, = {Zi, . . . , he a set of m, indices chosen independently 
and uniformly at random from {1, . . . ,N}, and Tl (a) he the best s-sparse approximation of the (possibly 
non-sparse) vector ot G C^. Let the noisy measurements y — An a + n G C™ be given with ||n||2 — 
Si^i I'^il^ ^ ! ^ 0. For some universal constants D,E > and 7 > 1, if relation ^ holds, then the 
solution a* of the £1 -minimization problem 



satisfies 



a* = arg min |jQ;||i subject to \\y - A^aiy < ?7, (5) 



Ic-c^h^D^^^^^^'^+E,, (6) 



with probability at least 1 - iV-7iog^(W), 

In the above theorems, the role of the mutual coherence fj, is crucial as the number of measurements 
needed to reconstruct x scales quadratically with its value. In the worst case where and ^ are identical, 
fi = 1 and the signal x is probed in a domain where it is also sparse. According to relation Q, the number 
of measurements necessary to recover x is of order N. This result is actually very intuitive. For an accurate 
reconstruction of signals sampled in their sparsity domain, all the non-zero entries need to be probed. It 
becomes highly probable when to ~ A^. On the contrary, when and are as incoherent as possible, 
i.e., fi — N~^/'^, the energy of the sparsity basis vectors spreads equally over the sensing basis vectors. 
Consequently, whatever the sensing basis vector selected, one always gets information of all the sparsity 
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basis vectors describing the signal x, therefore reducing the need in the number of measurements. This is 
confirmed by relation Q which shows that the number of measurements is of the order of s when /i ~ N^^/-^ . 
To achieve much better performance when the mutual coherence is not optimal, one would naturally try to 
modify the measurement process to achieve a better global incoherence. We will see in the next section that 
a simple random pre- modulation is an efficient way to achieve this goal whatever the sparsity matrix Uf. 



2.2 Pre-modulation effect on the mutual coherence 

The spread spectrum technique consists of pre- modulating the signal a; by a wide-band signal c = (Q)i^/^Ar G 
C^, with |ci| = 1 and random phases, before projecting the resulting signal onto m vectors of the basis $. 
The measurement vector y thus satisfies 

y = a with A?, = <^},C^ e C'"^^^, (7) 

where the additional matrix C G M^^^ stands for the diagonal matrix associated to the sequence c. 

In this setting, the matrix A'^ is orthonormal. Therefore, the recovery condition of sparse signals sampled 
with this matrix depends on the mutual coherence /x = maxi^i^^^r \ {4>i^ Qxl)j)\. With a pre-modulation by 
a random Rademacher or Steinhaus sequence. Lemma [l] shows that the mutual coherence is essentially 
bounded by the modulus-coherence /3 (<t>, Uf) defined in equation (|3|. 

Lemma 1. Let e G (0, 1), c G he a random Rademacher or Steinhaus sequence and C G C^^^ he the 
associated diagonal matrix. Then, the mutual coherence /i = maxi^ij^^r |(^j,Ct/'j)| satisfies 



/x</3(cD,^J/) V21og(2iVVe), (8) 

with prohahilty at least 1 — e. 

The proof of Lemma [l] relies on a simple application of the Hoeffding's inequality and the union bound. 

Proof. We have {cf>i,Cxpj) = J2k=i^k4'*ki'^kj = SfcLiCfcafe , where ajf = 4>liil>k]- An application of the 
Hoeffding's inequality shows that 

P(|(</.„C-0,)|>u)s^2exp (^-^ 



for all u > and 1 ^ i, j ^ N , with |la*^ |l2 = J2k=i pfc | • "^^^ union bound then yields 



for ah u > 0. As /J^ (cD, H/) = maxi^ij^jv Efc=i ^k ^ t^ien \\a'i\\l ^ ^1/) for aU 1 < i, j iV, and the 

previous relation becomes 



for all M > 0. Taking u = (0, v|/) log {2N'^/e) terminates the proof. □ 
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2.3 Sparse recovery with the spread spectrum technique 

Combining Theorem [T] with the previous estimate on the mutual coherence, we can state the following 
theorem: 

Theorem 3. Let c €! C^, with N ^ 2, be a random Rademacher or Steinhaus sequence, C €E C^^^ be 
the diagonal matrix associated to c, a G be an s-sparse vector, ^ = {li, . . . , 1^,} be a set of m indices 
chosen independently and uniformly at random from {!,..., N}, and y = A^o; G C™, with A'^ = <t>*C^. For 
some constants < p < log'^(A^) and Cp > 0, if 

m ^ CpTV/?^ (0, VI/) slog^(iV), (9) 

then a is the unique minimizer of the £i-minimization problem with probability at least 1 — O (N~p). 

Proof. It is straightforward to check that C*C = CC* = I where I is the identity matrix. The matrix 
A'^ ~ ct)*CU' is thus orthonormal and Theorem [l] applies. To keep the notations simple, let us denote F 
the event of failure of the ^i-minimization problem ([2|, X the event m ^ CTV/i^s log"* (A^), and Y the event 
/? (4>, Uf) y/2 log {2N'^/e) ^ /i. According to Theorem |l] and Lemma [ij the probability of F given X satisfies 
¥{F\X) iV-''i°s'(^) and the probabihty of Y satisfies ¥{Y) ^ 1 - e. 

We will shortly see that for a proper choice of e, when condition (|9| holds, we have 

TO> 2C N^'^ {<P,^)s\og{2N'^/e)\og^{N). (10) 

Using this fact, we compute the probability of failure V{F) of the £i minimization problem. We start by 
noticing that 

P{F) = ¥{F\X)¥{X) + P(F|X=)P(X=) < V{F\X) + ViX") < W(A') + ^x"), 

where X'^ denotes the complement of event X. In the first inequality, the probability P{X) and V{F\X'^) are 
saturated to 1. One can also note that if /3 (0, U') y^2 log {2N'^/e) > /i, i.e., Y occurs, condition ( 10 ) implies 
that m ^ CNfj,'^s\og^{N), i.e., X occurs. Therefore F{X\Y) = 1, P(X'=|y) = and 

Fix") = p(x=|r)P(r) + p(x'=|r'=)P(y^) = p(x=|r'=)P(r'=) p [y") sc e. 



The probability of failure is thus bounded above by N '^^^ +e. Consequently, if condition (10) holds 
with e = N^P and < p < log^(iV), a is the unique minimizer of the £i-niinimization problem i2l with 
probabihty at least 1 - 0{N-p). 

Finally, noticing that for e = N^p with N ^ 2, condition (10) always holds when condition ([9|, with 
Cp — 2{3 + p)C, is satisfied, terminates the proof. □ 

Note that relation ([9| also ensures the stability of the spread spectrum technique relative to noise and 
compressibility by combination of Theorem [2] and Lemma [T] 



2.4 Universal sensing bases with ideal modulus-coherence 

Theorem [3] shows that the performance of the spread spectrum technique is driven by the modulus-coherence 
/3 (0, vj/). In general the spread spectrum technique is not universal and the number of measurements required 
for accurate reconstructions depends on the value of this parameter. 
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Definition 1. (Universal sensing basis) An orthonormal basis G (J^-WxAt called a universal sensing basis 
if all its entries (pki, ^ ^ k,i ^ N , are of equal complex magnitude. 

For universal sensing bases, e.g. the Fourier transform or the Hadamard transform, we have \4>ki\ — N~^^^ 
for ah 1 ^ fc,i N. It follows that /3(ct>,U') = A^^^/^ and fi ~ A^"^/^, i.e. its optimal value up to a 
logarithmic factor, whatever the sparsity matrix considered! For such sensing matrices, the spread spectrum 
technique is thus a simple and efficient way to render a system incoherent independently of the sparsity 
matrix. 

Corollary 1. (Spread spectrum universality) Let c G C^, with N ^ 2, be a random Rademacher or Steinhaus 
sequence, C G (£NxN diagonal matrix associated to c, a E be an s-sparse vector, il — {li, . . . , 

be a set of m indices chosen independently and uniformly at random from {1, . . . , N}, and y — A^cc G C™, 
with A*^ = 4>*CU'. For some constants < p < \og^{N), Cp > 0, and universal sensing bases 4> G C^^^ , if 

m^Cpslog^N), (11) 

then a is the unique minimizer of the ii-minimization problem ^ with probability at least 1 — O (N^p). 

For universal sensing bases, the spread spectrum technique is thus universal: the recovery condition 
does not depend on the sparsity basis and the number of measurements needed to reconstruct sparse signals 
is optimal in the sense that it is reduced to the sparsity level s. The technique is also efficient as the 
pre-modulation only requires a sample-by-sample multiplication between x and c. Furthermore, fast multi- 
plication matrix algorithms are available for several universal sensing bases such as the Fourier or Hadamard 
bases. 

In light of Corollary [TJ one can notice that sampling sparse signals in the Fourier basis is a universal 
encoding strategy whatever the sparsity basis - even if the original signal is itself sparse in the Fourier 
basis! We will confirm these results experimentally in Section [3] 



2.5 Related work 



Let us acknowledge that the techniques proposed in 32 ■ 37 can be related to the spread spectrum technique. 
The benefit of a random pre-modulation in the measurement system is already briefly suggested in 32 . The 



proofs of the claims presented in that conference paper have very recently been accepted for publication in 33 



during the review process of this paper. The authors obtain similar recovery results as those presented here. 
In 34 , the author proposes to convolve the signal x with a random waveform and randomly under-sample 
the result in time-domain. The random convolution is performed through a random pre-modulation in the 
Fourier domain and the signal thus spreads in time-domain. In our setting, this method actually corresponds 
to taking <J> as the Fourier matrix and v|/ as the composition of the Fourier matrix and the initial sparsity 
matrix. In (35| , the authors propose a technique to sample signals sparse in the Fourier domain. They first 
pre-modulate the signal by a random sequence, then apply a low-pass antialiasing filter, and finally sample 
it at low rate. Finally, random pre-modulation is also used in 36 and 37 but for dimension reduction and 
low dimensional embedding. 

We recover similar results, albeit in a different way. We also have a more general interpretation. In 
particular, we proved that changing the sensing matrix from the Fourier basis to the Hadamard does not 
change the recovery condition (111. 
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3 Numerical simulations 

In this section, we confirm our theoretical predictions by showing, through a numerical analysis of the phase 
transition of the ^i-minimization problem, that the spread spectrum technique is universal for the Fourier 
and Hadamard sensing bases. 



3.1 Settings 

For the first set of simulations, we consider the Dirac, Fourier and Haar wavelet bases as sparsity basis U' 
and choose the Fourier basis as the sensing matrix 4). We generate complex s-sparse signals of size N — 1024 
with s G {1, . . . , N}. The positions of the non-zero coefficients are chosen uniformly at random in {1, ... , N}, 
their phases are set by generating a Steinhaus sequence, and their amplitudes follow a uniform distribution 
over [0,1]. The signals are then probed according to relation ([T]) or Q and reconstructed from different 
number of measurements m G {s, . . . , 10s} by solving the ^i-minimization problem ([2| with the SPGLl 
toolbox 38 39 . For each pair (m, s), we compute the probability of recoverjj^ over 100 simulations. 

For the second set of simulations, the same protocol is applied with the same sparsity basis but with the 
Hadamard basis as the sensing matrix <t>. 



3.2 Results 

Figure [T] shows the phase transitions of the -minimization problem obtained for sparse signals in the Dirac, 
Haar and Fourier sparsity bases and probed in the Fourier basis with and without random pre-modulation. 
Figure [2] shows the same graphs but with measurements performed in the Hadamard basis. 

In the absence of pre-modulation, one can note that the phase transitions depend on the mutual coherence 
of the system as predicted by Theorem [T] For the pairs Fourier-Dirac and Hadamard-Dirac, the mutual 
coherence is optimal and the experimental phase transitions match the one of Donoho- Tanner (dashed green 
line) 1 5 . For all the other cases, the coherence is not optimal and the region where the signals are recovered 
is much smaller. The worst case is obtained for the pair Fourier- Fourier for which fj, = 1. 

In the presence of pre-modulation. Corollary [l] predicts that the performance should not depend on the 
sparsity basis and should become optimal. It is confirmed by the phases transition showed on Figures [l] and 
[2] as they all match the phase transition of Donoho- Tanner, even for the pair Fourier-Fourier! 

4 Application to realistic Fourier imaging 

In this section, we discuss the application of the spread spectrum technique to realistic analog Fourier 
imaging such as radio interferometric imaging or MRI. Firstly, we introduce the exact sensing matrix needed 
to account for the analog nature of the imaging problem. Secondly, while our original theoretical results 
strictly hold only in a digital setting, we derive explicit performance guarantees for the analog version of the 
spread spectrum technique. We also confirm on the basis of simulations that the spread spectrum technique 
drastically enhances the quality of reconstructed signals. 

^perfect recovery is considered if the I2 norm between the original signal x and the reconstructed signal x* satisfy: ||£c — 
x*\\2 ^ 10-^||a;||2. 
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Figure 1: Phase transition of the ^i-niinimization problem for different sparsity bases and random selection 
of Fourier measurements without (left panels) and with (right panels) random modulation. The sparsity 
bases considered are the Dirac basis (top), the Haar wavelet basis (center), and the Fourier basis (bottom). 
The dashed green line indicates the phase transition of Donoho- Tanner [s] . The color bar goes from white 
to black indicating a probability of recovery from to 1. 
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Figure 2: Phase transition of the £i-minimization problem for different sparsity bases and random selection 
of Hadamard measurements without (left panels) and with (right panels) random modulation. The sparsity 
bases considered are the Dirac basis (top), the Haar wavelet basis (center), and the Fourier basis (bottom). 
The dashed green line indicates the phase transition of Donoho- Tanner [s] . The color bar goes from white 
to black indicating a probability of recovery from to 1. 
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4.1 Sensing model 

Radio interferometry dates back to more than sixty years ago 40 -43 . It allows observations of the sky with 
angular resolutions and sensitivities inaccessible with a single telescope. In a few words, radio telescope 
arrays synthesize the aperture of a unique telescope whose size would be the maximum projected distance 
between two telescopes of the array on the plane perpendicular to line of sight. Considering small field of 
views, the signal probed can be considered as a planar image on the plane perpendicular to the pointing 
direction of the instrument. Measurements are obtained through correlation of the incoming electric fields 
between each pair of telescopes. As showed by the van Cittert-Zernike theorem 43 , these measurements 
correspond to the Fourier transform of the image multiplied by an illumination function. In general, the 
number of spatial frequencies probed are much smaller than the number of frequencies required by the 
Nyquist-Shannon theorem, so that the Fourier coverage is incomplete. An ill-posed inverse problem is thus 
defined for reconstruction of the original image. To address this problem, approaches based on compressed 



sensing have recently been developed 10 ■ 12 



MR images are created by nuclear magnetic resonance in the tissues to be imaged. Standard MR measure- 
ments take the form of Fourier (also called fc-space) coefficients of the image of interest. These measurements 
are obtained by application of linear gradient magnetic fields that provides the Fourier coefficient of the sig- 
nal at a spatial frequency proportional the gradient strength and its duration of application. Accelerating 
the acquisition process, or equivalently increasing the achievable resolution for a fixed acquisition time, is 
of major interest for MRI applications. To address this problem, recent approaches based on compressed 
sensing seek to reconstruct the signal from incomplete information. In this context, several approaches have 



been designed 13 28 -30 44 -48 



In light of the results of Section [2] Fourier imaging is a perfect framework for the spread spectrum 
technique, apart from the analog nature of the corresponding imaging problems. In the quoted applications, 
the random pre-modulation is replaced by a linear chirp pre-modulation 25 -30 . In radio interferometry, this 



modulation is inherently part of the acquisition process (25 26 . In MRI, it is easily implemented through 



the use of dedicated coils or RF pulses 29 30 . For two-dimensional signals, the linear chirp with chirp rate 
w S E reads as a complex- valued function c : r i— >■ e"^™"^^ of the spatial variable t G . Note that for high 
chirp rates w, i.e. for chirp whose band-limit is of the same order of the band-limit of the signal, this chirp 
shares the following important properties with the random modulation; it is a wide-band signal which does 
not change the norm of the signal \c(t)\ = 1 whatever r e M . 

In this setting, the complete linear relationship between the signal and the measurements is given by 



y 



A^awith A- 



(12) 



In the above equation, the matrix U represents an up-sampling operator needed to avoid any aliasing of 
the modulated signal due to a lack of sampling resolution in a digital description of the originally analog 
problem. The convolution in Fourier space induced by the analog modulation implies, in contrast with the 
digital setting studied before, that the band limit of the modulated signal is the sum of the individual band 
limits of the original signal and of the chirp c. We assume here that, on its finite field of view L, the 
signal X is approximately band-limited with a cut-off frequency at B, i.e., its energy beyond the frequency 
B is negligible. The signal x is thus discretized on a grid of iV = 2LB points. On this field of view L, the 
linear chirp c may be approximated by a band limited function of band limit identified by its maximum 
instantaneous frequency \w\L/2. This band limit can also be parametrized in terms of a discrete chirp rate 
w = wL'^/N and thus \w\L/2 = \w\ B. Therefore, an up-sampled grid with at least = (1 -|- |ui|)A^ points 
needs to be considered and the modulated signal is correctly obtained by applying the chirp modulation 
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Original image Without chirp modulation With chirp modulation 




Figure 3: Top panels: Image of the giant elliptical galaxy NGC1316 (center of the image) devouring its small 
northern neighbor. The image shows the radio emission associated with this encounter superimposed on an 
optical image. The radio emission was imaged using the Very Large Array in New Mexico (Image courtesy 
of NRAO/AUl and J. M. Uson). The image size is = 256 x 256. Bottom panels: MRI image of a brain 
from the Brainix database. From left to right: original image; complex magnitudes of the reconstructed 
images from m = QAN measurements without chirp modulation; complex magnitudes of the reconstructed 
images from m ~ QAN measurements with chirp modulation. 

on the signal after up-sampling on the points gricj^ The up-sampling operator U, implemented in 
Fourier space by zero padding, is of size A'^, x N and satisfies U*U = I G C^^^. Finally, the matrix 
C G c^mX^iu jg ^j^g diagonal matrix implementing the chirp modulation on this up-sampled grid and the 
matrix F = {fi)i<i<N ^ i^n^^-kn^^ stands for the discrete Fourier basis on the same grid. The indices 
f2 = {Zi, ...,/,„} of the Fourier vectors selected to probe the signal are chosen independently and uniformly 
at random from {1, . . . , N^}. 

4.2 Illustration 

Up to the introduction of the matrix U and the substitution of the linear chirp modulation for the random 
modulation, we are in the same setting as the one studied in Section [2] To illustrate the effectiveness of 
the spread spectrum technique, we consider two images of size A^ = 256 x 256 showed in Figure [3] The 

^In a full generality, natural signals are not necessarily band-limited. The spread spectrum technique can easily be adapted 
to this case. The sensing model should simply be modified to account for the fact that, if measurements are performed at 
frequencies up to a band limit B, they unavoidably contain energy of the signal up to band limit (1 + w)B. 
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first image shows the radio emission associated with the encounter of a galaxy with its northern neighbor. 
It was acquired with the Very Large Array in New Mexico 49 . The second image shows a brain acquired 
in an MRI scanner. This image is part of the Brainix database [50]. These images are probed according 
to relation (12) in the absence {id = 0) and presence (w = 0.1) of a linear chirp modulation. Independent 
and identically distributed Gaussian noise with zero-mean is also added to the measurements. The variance 
cr^ of the noise is defined such that the input snr — — lOlogj^Q (cr^/E^) is 30 dB {J^x stands for the sampled 
standard deviation of x). The images are reconstructed from m = OAN complex Fourier measurements by 
solving the £i-minimization problem ([s]). Note that in order to stay in the setting of the theorems presented 
so far, no reality constraint is enforced in the reconstructions, so that the reconstructed images are complex 
valued. The sparsity bases used are the Daubechies-6 and Haar wavelet bases for the galaxy and the brain 
respectively. In each case, 20 reconstructions are performed for different noise and mask realizations. The 
complex magnitudes of reconstructed images with median mean squared errors are presented in Figure |3] 

In the absence of linear chirp modulation, the quality of the reconstructed image is very low. However, 
one can already note that the fine scale structures are much better reconstructed than those at large scales. 
The fine details live at the small scales of the wavelet decomposition whereas the large structures live at 
larger scales. The small scale wavelets being more incoherent with the Fourier basis than the larger wavelets, 
the high frequency details are naturally better recovered. 

In the presence of the linear chirp modulation, all the wavelets in U' become optimally incoherent with the 
Fourier basis thanks to the universality of the spread spectrum technique. Consequently, as one can observe 
on Figure [Sj the low and high frequency details are better reconstructed and the image quality is drastically 
enhanced. Note that much better reconstructions can be obtained for the brain image by substituting the 
Total Variation norn|^ for the £i norm in ^ [l3 30 . However, Theorems [l] and [s] do not hold for such a 
norm. 

Let us acknowledge that these simulations are not fully realistic. For example, in radio-interferometry, 
the spatial frequency cannot be chosen at random. To simulate realistic acquisitions, one would have to 
consider non-random measurements in the continuous Fourier plane. Such a study is beyond the scope of 
this work. However, in the context of MRI, part of the authors implemented and tested this technique on a 



real scanner with in vivo acquisitions 29 30 



4.3 Modified recovery condition 

Because of the modifications introduced in (12 1 to account for the analog nature of the problem, the digital 
theory associated with the measurement matrix ([7| does not explicitly apply. Nevertheless, the previous 
illustration shows that the spread spectrum technique is indeed still very effective in this analog setting. 
Actually, performance guarantees similar to Theorem [l] may be obtained in this setting. 

Theorem 4. Let A™ = F*CUM/ e c^nxN ^ ^ maxi^ij^A? CU'0j)|, a e 6e an s-sparse vector, 
fl — {li, . . . , Ifn} be a set of m indices chosen independently and uniformly at random from {1, . . . , N^}, and 
y = Af^a G C". For some universal constants C > and 7 > 1, if the number of measurements m satisfies 

m^CN^tilsXog'iN), (13) 

then a is the unique minimizer of the ii -minimization problem ^ with probability at least 1 — iV~T'°s i^) ^ 
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Proof. The proof follows directly from Theorem 4.4 in [7. Indeed, Theorem 4.4 applies to any matrices Ao 
associated to an orthonormal system (with respect to the probability measure used to draw il) that satisfies 
the so-called boundedness condition (see Section 4.1 of [t] for more details). 

~ ~ 1/2 — 

Let us denote A'" = {dik)i^i.k^N — Nj A™ the normalized measurement matrix. It is easy to check 
that this new matrix is orthonormal relative to the discrete uniform probability measure on {1, . . . , A^mi}- 
Indeed 

i=l i=l 

as U*U = I G i£_n-kn ^^i^ (-*(- _ pp* _ I ^ (j^w^xAT^^ Furthermore, the boundedness condition is satisfied as 
maxi^ij-^AT |a™ | ^ iV^/^/i^. Applying Theorem 4.4 in Jt] to the matrix A"" terminates the proof. □ 

Note that Theorem 4.4 in [t] also ensures that our analog sensing scheme is stable relative to noise and 
non exact sparsity if condition (|13p is satisfied. Also note that one can obtain a similar results using Theorem 



1.1 and 1.2 of the very recently accepted paper 51 



In view of this theorem, one can notice that the number of measurements needed for accurate reconstruc- 
tions of sparse signals is proportional to the sparsity s times the product N^j /i^ , with factors depending 
on the chirp rate w. In the analog framework, two effects are actually competing. On the one hand, the 
mutual coherence //^ of the system is decreasing with the spread spectrum phenomenon, but, on the other 
hand, the number of accessible frequencies that bear information is increasing linearly with the chirp 
rate. The optimal recovery conditions are reached for a chirp rate w that ensures that the product Nyj /i^ is 
at its minimum. This minimum might change depending on the sparsity matrix, so the universality of the 
recovery is formally lost. 

To illustrate this effect. Table [l] shows values of the product iV„ /x^ for different chirp rates w and two 
different sparsity matrices: the Fourier and the Dirac bases. The values are computed numerically for a size 
of signal N — 1024. In the case of the Dirac basis, one can notice that the product /j,^ slightly increases 
with the chirp rate, thus predicting that the performance should even slightly diminish in the presence of a 
chirp. On the contrary, the product is drastically reduced for the Fourier basis as w increases, predicting a 
significant performance improvement in the presence of chirp modulation. 



4.4 Experiments 

To confirm the theoretical predictions of the previous section, we consider the Dirac and Fourier bases as 
sparsity matrices vl/. We then generate complex s-sparse signals of size N = 1024 with s — 10. The positions 
of the non-zero coefficients are chosen uniformly at random in {1, . . . , A^}, their signs are set by generating 



Sparsity basis 


Dirac 


Fourier 


fil^ at u) = 


1.00 


1.02 • 103 


Ny,^j,l atw = 0.10 


2.58 


1.54- IQi 


Ny, at w = 0.25 


3.15 


6.95 


at w = 0.50 


3.46 


4.13 



Table 1: Infiuence of a chirp modulation on /i^ 



14 



Dirac sparsity basis 



Fourier sparsity basis 





0.8 



0.6 , w = 0.25 



0.4 



0.2- f' 10 = 0.1 



50 100 150 200 
m 



Q bofflooooooooooooooooooooooooooo^o 

250 200 400 600 800 1000 

m 



Figure 4: Probability of recovery e of 10-sparse signals as a function of the number measurement m obtained 



with the measurement matrix ( 12 1 for two different sparsity basis: the Dirac basis (left) and the Fourier basis 
(right). The continuous black curve corresponds to the probability of recovery for Hj = 0. The dot-dashed 
blue curve corresponds to the probability of recovery for iB = 0.1. The dashed black curve corresponds to 
the probability of recovery for w — 0.25. The continuous red curve corresponds to the probability of recovery 
for w — 0.5. 



a Steinhaus sequence, and their amplitudes follow a uniform distribution in [0,1]. The signals are then 
probed according to relation ( 12 ) and reconstructed from different number of measurements m e {s, . . . , N} 
by solving the £i-minimization problem ^ with the SPGLl toolbox. For each pair (m, s), we compute the 
probability of recovery over 100 simulations for different chirp rate Hi € {0,0.1,0.25,0.5}. Figure |4] shows 
the probability of recovery e as a function of the number of measurements. 

Firstly, in the case where W is the Dirac basis, one can notice that the number of measurements needed 
to reach a probability of recovery of 1 slightly increases with the chirp rate w. This is in line with the value 
in Table [l] and Theorem HI 

Secondly, in the case where U' is the Fourier basis, the performance becomes much better in the presence 
of a chirp. As predicted by the value in Table [l] the improvement is drastic when w goes from to 0.1 and 
then starts to saturate between 0.1 and 0.5. 

Thirdly, according to Table [l] the product fJ.^ is equal to 4.13 for the Fourier basis when w = 0.5. 
This is nearly the value obtained with the Dirac basis for the same chirp rate, suggesting the same probability 
of recovery for the same number of measurements. Indeed, one can notice on Figure |4] that the number of 
measurement needed to reach a probability of recovery of 1 is around 100 in both cases. 

Finally, these results also suggest that the spread spectrum technique in the modified setting is almost 
universal in practice. Indeed, for the perfectly incoherent pair Fourier-Dirac of sensing-sparsity bases, the 
number of measurements needed for perfect recovery is around 100 and this number remains almost un- 
changed in presence of the linear chirp modulation. Furthermore, for the pair Fourier-Fourier, the spread 
spectrum technique allows to reduce the number of measurements for perfect recovery close to this optimal 
value. 
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5 Conclusion 

Wc have presented a compressed sensing strategy that consists of a wide bandwidth pre-modulation of the 
signal of interest before projection onto randomly selected vectors of an orthonormal basis. In a digital 
setting with a random pre-modulation, the technique was proved to be universal for sensing bases such as 
the Fourier or Hadamard bases, where it may be implemented efficiently. Our results were confirmed through 
a numerical analysis of the phase transition of the -minimization problem for different pairs of sensing and 
sparsity bases. 

The spread spectrum technique was also shown to be of great interest for realistic analog Fourier imaging. 
In applications such as radio interferometry and MRI, the originally digital random pre-modulation may be 
mimicked by an analog linear chirp. Explicit performance guarantees for the analog version of the technique 
with a chirp modulation were derived. It shows that recovery results are still enhanced in this setting, 
though universality does not strictly hold anymore. Numerical simulations have shown that the quality of 
reconstructed signals is drastically enhanced in this more realistic setting, also for pairs of sensing- sparsity 
bases initially highly coherent, such as the Fourier-Fourier pair. 
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